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Summar y 



The National Science Teachers Associations Educational 
Technology Project developed and progressively defined an 
assortment of instructional material for use with science 
supervisors. Continuous revisions were made throughout the 
development process and all materials were validated to the 
degree that time and funds permitted. These materials have 
three major purposes: 

1. to develop understanding and initial skills in 
, educational ■ technology , 

2 . to provide learning techniques and materials that 
can be used by a supervisor to meet local needs, 

3. and to utilize the process of educational technology 
to teach a working concept of educational technology. 

The materials produced are grouped into four set6 : 

I - Role of the Science Supervisor 

II - Introduction to Educational Technology 

III - An Application of Educational Technology 

IV - Management 

Each of the first two sets is composed of a number of 

instructional packages with each package being an independent 
unit covering a specific aspect within the et. A complete 
list of titles included in these packages is at the end of 
this summary. 

These materials have all been validated to some degree 
through use with science supervisors. The results of these 
activities provided feedback which formed the basis for ex- 
tensive revisions of all of the materials. Specific evalu- 
ative activities are covered in the body of this report. 

These materials can be used on an individual basis, 
employing individual sets or parts of sets, or as an entire 
unit. However, the most benefit from use of the full set of 
materials is anticipated in an institute setting managed on 
an individualized learning basis. Each supervisor attending 
the institute would then utilize the project material and 
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r.elect support materials in such a way as to meet his pio- 
fessional needs and background. Interaction with peers is 
considered vital to the fullest exploitation of the materials 
developed . 

This project produced learning materials. The results 
of the effort will be successful only to the extent that 
these materials are utilized and proved to be effective. 

The validation effort yielded evidence that the materials 
have value to science supervisors and should be' distributed. 



Packages Produced 

i 

Set I - Role of the Science Supervisor 

1. Curriculum Revision - audio tape/slides 

and workbook 

2. Evaluation - audio tape/slides and workbook 

3. Management - audio tape/slides and workbook 

4. Public Relations - audio tape/slides and 

workbook 

5. Research - audio tape/slides and workbook 



Set II 



Set III 



Set IV 



Introduction to Educational Technology 

1. Toward a Definition - Audio tape/slides 

and criterion tests 

2. The Individual Learner - audio tape/elides 

and criterion tests 

3. Learning Pyramid - audio tape and criterion 

tests 

4. Closing the Loop - audio tape/slides and 

criterion tests 

5. Production - audio tape 

6. Diagnostic Testing - audio tape and 

criterion tests 

7. Criterion Referenced vs. Worm Referenced 

Testing - audio tape and criterion tests 

An application of Educational Technology 
Total set is composed of a printed interaction 
workbook . 

Management 

Total set is composed of a Management Systems 
Kit. 
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Introduction 



This report is composed of five volumes of material. 
Volume one is the formal project report containing a history, 
methods of development and rationale, validation activities 
and results, and conclusions, along with support items as 
necessary. Volume one, then, comprises the report submission 
requirements of the project. 

Volumes two through five contain the products of the 
project. Bach volume contains one of the four sets of 
materials developed by the project: instructions, criterion 

tests, learning content (scripts, simulation information, or 
kit material) and bibliographic extension material. The 
production of materials generated during this project is in- 
corporated in these four volumes. 

Briefly, this project evolved to meet two distinct 
supervisory needs In science education: 

First) A need for inservice training materials 
for science supervisors in the area of 
educational technology. 

Second) Skill in utilization of educational 

technology processes to improve science 
education programs. 

The process of educational technology offers an effective 
tool for the science supervisor, both in organizing to meet 
his professional responsibilities and in providing for the 
improvement of science education programs. Educational tech- 
nology processes were used to a degree in the development of 
project materials to meet the above needs in order to provide 
an exemplary approach to the development of instructional 
materials. By utilizing educational technology processes, the 
project produced all materials in a self-contained package 
format. This approach permits the use of individual packages 
by the science supervisor to meet local needs. However, the 
material was developed as a total instructional unit for use 
in an institute for science supervisors and was grouped into 
four sets of individual packages. 
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Set I - Role of the Science Supervisor 
(Volume two in this report) 

The five packages in this set are designed to orient 
the science supervisor to his job functions in a very 
broad sense. They present for the new supervisor a 
spectrum of activities by which he may structure his own 
role. For the experienced supervisor they present new 
areas for his consideration and suggest a reevaluation 
of priorities- Science supervisors are not told what to 
do, but they will be given information and motivation 
for expanding and reorienting their own functions. The 
packages contained in Set I are: 

Curriculum Revision 

Evaluation 

Management 

Public Relations 

Research 

These materials are all tape-slide presentations with 
pre-post assessments and utilization directions. Addi- 
tional bibliographic .support material is included which 
provide. 8 for in-depth exploration of the various aspects 
presented in the packages. As a result, each supervisor 
is presented with a broad spectrum of supervisory functions 
along with opportunity for detailed exploration of areas 
of interest to him. 

Set II - Introduction to Educational Technology 
(Volume three in this report) 

This set consists of three levels of material. Level 
one has five packages: 

Toward a Definition 
The Individual Learner 
Learning Pyramid 
Closing' the Loop 
Production 

All of the packages are tape-slide presentations 
except "Learning Pyramid" and "Production" which are 
audio-tape presentations without visuals. The materials 
on level one are all designed for motivation and initial 
exposure to the educational technology process. Success 
of level one material in supplying motivation is measured 
by the degree of use of level' two and level three materials. 

* l 
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Level two consists of two audio-tape packages 
developed by the project: Criterion Referenced vs. 

Norm Referenced Testing, Diagnostic Testing, and five 
commercially available packages. All of the materials 
on this level are designed to develop initial basic 
skills and competencies in specific areas of educational 
technology (formulation of objectives, criterion testing, 
learning materials design, media, and instructional 
systems). It is not intended to enable the science 
supervisor to be a skilled educational t schnologis t ; 
rather the intent is to provide a fairly extensive ex- 
posure and orientation to educational technology. 

Level three includes additional bibliographic 
references providing more specific detail than the two 
earlier levels. This provides the individual science 
supervisor with in-depth material to meet his individual 
needs and interests. 

There is no claim made that anyone who is able to 
meet the terminal behavior characteristic© of Set II is, 
by that exercise, a highly qualified educational tech- 
nologist. 

Set III - Applications of Educational Technology 
(Volume four of this report) 

This set consists entirely of printed material. It 
provides a structure for the science supervisor to use 
in developing an understanding of a systems approach 
for the preparation of an inservice program in a local 
school system. The supervisor is involved in three 
distinct activities. First, he develops the structure 
of an inservice program for his own local needs according 
to the general outline provided. Second, he works through 
the structure and background of a model inservice in- 
stitute to provide for implementation of a curriculum 
stressing scientific literacy. All of the necessary in- 
formation, curriculum structure, information on par- 
ticipants, and institute structure are included. Third, 
the supervisor evaluates and revises his own inservice 
program using the model as a guide. 

This set provides the supervisor with practical 
dklxls in applying educational technology to meet his own 
inservice needs. In addition, and perhaps more impor- 
tantly, the supervisor has a workable systems model which 
he can use for an inservice program of hi© own that can 
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be expanded and used in his local school context* 

Set IV - Management (Volume five of this report) 

This set consists entirely of a management kit. 

The kit provides the science supervisor with the 
direction and materials necessary to develop operating 
system diagrams of his own management activities. As 
such, it utilizes educational technology in a systems 
approach to the supervisor's management role. Three 
distinct outcomes result fr<pm this set. First, the 
supervisor is able to transfer the systems approach to 
areas other than those presented in Sets II and III. 
Second, the supervisor develops system diagrams of his 
actual activities. For most supervisors, this becomes 
the first visualization of their activities in any 
systematic way. Third, the supervisor is provided with 
other systems and details with which he can interact 
in order to strengthen his own systems. 

There is no rigid definable end to this set. It 
is designed to be open-ended. The supervisor leaves 
with a series of revised system charts that meet his 
real needs, but he also has material and outlines for 
extending the analysis of his charts to any desired 
depth. 



Although the sets are numbered I, II, III, and IV, the 
order of utilization is flexible as well as the order and 
use of individual packages within the sets. Development 
took place in the order listed and the suggested sequence 
listed represents a logical approach which may be utilized. 
Appendix A follows the initial operation sequencing and a 
revised sequence developed as a result of the large group 
validations, 



Methods 



The project utilized educational technology to a limited 
degree as a process in developing the materials. The pro- 
cedures outlined as follows were generally followed and will 
be discussed in detail. 

A. Specif icatioi. of Objectives 



B. Assessment Criteria for Objectives 

C. Specification of Participant Characteristics 

D. Development of Learning Sequences (to provide for 
individual needs) 

B, Production of Materials 

F. Validation of Materials 

G. Revision of Materials 

H. Development of a Management System for Utilization 

of Material 

Although this outline was the guide in material develop- 
ment, it must be admitted at the start that it was not alv/ays 
rigidly followed. Variations in approach, however, were not 
made without conscious decision on the part of the project 
staff, and were often made due to financial and resource con- 
straints. The process of an educational technology approach 
to production of materials is, by its very philosophy, a 
flexible approach that adapts to the needs of thf learner. 

In the process of developing these materials, as much was 
learned by the project staff as will be learned by those 
utilizing the material. Many of these ideas and methods will 
form a part of the conclusions section of this report. 

A. Initial objectives for the project were determined 
through a small study funded by the Office of Education - 
Bureau of Research (USOE Project No. 7C006 , Contract No. OEC- 
1-7-070006-3789, in 1967, The Use of Educational Technology 
in Providing Knowledge of Educational Technology and Sugges- 
tion^ for its Application to .Science Superyisqrs) . The 
first step in the present project was the organization of the 
above objectives into a workable hierarchy developed in terms 
of the specific backgrounds and needs of science supervisors. 
From this detailed analysis of objectives, the idea of -four 
sets of materials Incorporating the given objectives, along 
with additional objectives leading to the acceptance of change 
and the transfer of skills, developed into a broad approach 
to provide the supervisory competencies required. The 
sets developed and their basic terminal objectives are: 
(Objectives in parenthesis are mainly affective in nature.) 

Set I - The science supervisor will be able to 
• identify specific areas where his science super- 
visory activities should be modified or enlarged. 

The supervisor will seek information in areas where 
he is unfamiliar. (openness to change) 
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Set II - The science supervisor will be able 
to define educational technology in process 
terms and identify areas within education where 
it might be applied. (The supervisor will seek 
to develop skills in various areas of educational 
technology . ) 

S et III - The science supervisor will apply the 
educational technology process in developing an 
inservice program. (The supervisor will utilize 
the Inservice program he has developed.) 

Set IV - The science supervisor will be able 
to utilize educational technology in other 
activity areas through development of systems 
charts for his management functions. (The super- 
visor will further evaluate and revise his own 
charts without being required to do so by the 
project staff.) 

Within each set there are a number of specific interim 
objectives and more expanded forms of the above terminal 
objectives. These are presented in detail as a part of 
volumes two through five. Initial objectives chosen at the 
beginning were not fixed rigidly and the above objectives 
represent the final produc - of many revisions throughout the 
project life. 

B. Assessment of the project objectives has and still 
remains somewhat a source of controversy. Even the most 
specific objectives cannot always be fully assessed by a 
paper and pencil exam. This is especially true of affective 
objectives. Project validation activity has led to signif- 
icant changes in staff approach to the use of criterion tests 
(or assessments). There are three different assessment 
methods for use with the project materials. If the project 
materials are used in their entirety, then the criterion 
assessment Included in Appendix D should be used. Participants 
going th ough all of the packages will complete a number of 
8pecl r i ' assessments. 

The assessment above, however, represents a general total 
osjessmert in both attitude and specific understanding. Al- 
though all of the individual tests give a more complete 
picture of the learning produced by the individual packages, 
the validation activities' showed that participant motivation 
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is inversely proportions! to the number and length of written 
criterion assessments given. This, however, in no way 
vitiates the importance of these kinds of data in acquiring 
the necessary developmental guidance needed. It seemed 
obvious that a learning system designed for mature and 
sophisticated participants concerned with high level pro- 
fessional performance requires some adaptation of generally 
accepted educational technology theory. 

The second typo of criterion assessments are the in- 
dividual tests provided with each individual package within 
the sets. These tests were utilized in the validation 
activities and during the development of the individual units. 
The final criterion assessments are not available in a 
written format similar to the other t"o type's since they deal 
with affective objectives. Some of the attitudes developed 
were Identified through the individual assessment sheets, 
Appendix D, used during the validation activities. Full 
attitude assessment requires a series of follow-up activities 
as well as implementation of the complete project materials 
in the proposed institute. 

C. Specifications of participant characteristics were 
initially outlined in the project proposal, i.e., science 
education personnel. Included within this very broad desig- 
nation are personnel whose major responsibilities involve 
the science program, ite development and implementation, 

and the teaching staff necessary to carry out the science 
program. This activity may be carried out within individual 
schools, intermediate units, or on state levels. Titles for 
this type ot person range through Supervisor, Science Depart- 
ment Head, Science Advisor, Science Consultant to Science 
Administrator. Although the materials are designed for this 
group, by. their flexibility of application, many of the 
packages produced will be applicable outside of the original 
population group. Certain background was assumed such as a 
college education, experience in science education, awareness 
of the general functions of a science supervisor and knowledge 
of the structure and operation of the existing science 
education program. Orher student characteristics such as 
specific background knowledge and skills are less critical 
in the design activity since utilization of the materials 
produced will vary according to the participant's experience, 
interests and learning needs. 

D. Development of Learning Sequences began with Set 1 
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and w ,> a continuing process of feedback and revision be** 
tween tne initial terminal objectives and realistic content 
preparation. Set I was broken down into five basic science 
supervisory responsibilities: "Curriculum Revision," 
"Evaluation," "Management," "Public Relations," "Research." 
These areas do not cover the entire scope of a science 
supervisor's activity, but they do comprlso the most impor- 
tant and ti mo-consuming areas. Realistic limitations of 
time, staff rnd funding necessitated compromises in idealized 
objectives. Similarly, Set II materials could (and possibly 
should) Include many more aspects of the educational tech- 
nology process than are present in the final material. In 
Set II, in order to provide for certain areas that could not 
be produced, commercially available materials are utilized. 

In addition, due to projoct limitations in production, 
commercial materials were Included for practical reasons— 
both to provide additional depth and comprehensiveness and 
to avoid unnecessary duplication. Where available materials 
could be identified as effective means to the defined 
learning ends, they were used. Sets III and IV required 
less u 8 e of commercial material because of their open-ended 
and self-initiating structure. In both cases it was decided 
that skill development necessary to meet the terminal 
objectives would come most effectively (both cognitive and 
motivational) from a discovery type of approach. The super- 
visor uses the cognitive knowledge developed in Sets I and 
II to meet specific needs structured into Sets III and IV. 

The learning sequences for the last two sets were developed 
on this basis and, as a result, are interactive rather than 
passive presentations. Although only a single linear 
learning strategy was developed for each set, individual 
learning needs tend to be met in actual application because 
of the built in flexibility and open-endednuss t»nd through 
the use of the available commercial materials that have been 
identified . 

E. Production of materials was based on very realistic 
assumptions. It would be ideal to utilize a broad spectrum 
of mediated materials in order to expose the science super- 
visor to the best possible uses of media- However, local 
use ot the produced material would be limited to areas and 
districts where more advanced media hardware is readily 
available. In addition, the cost per hour of production of 
sophisticated media is quite high and does not really Justify 
the desired learning outcomes. Media were chosen for ease 
of utilization, applicability and ease of production. All 
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of tho materials fall into ono or more of the following four 
formats: audio tape and slides; audio tape alone; printed 
material; and a manipulative kit (or game). In this way, a 
variety of easily usable material has been produced. Further 
sophistication could be introduced through interaction or 
assessment materials produced in eight or sixteen millimeter 
film format or on video tape. 

Another consideration for the choice of simple media 
usage is the participant learning characteristics. Exotic, 
nonprint media may inhibit rather than enhance communication 
with more traditional science supervisors. As in the choice 
of linear development for the learning sequences, variety of 
Implementation is achieved through flexible utilization of 
the material. 

F. Validation of Materials was the most important 
Activity in the entire project. The materials were evaluated 
and revised a number of times prior to production by the 
project staff and by science supervisors brought in as 
consultants. This activity eliminated some of the more 
obvious problems in both content and stylo. After production, 
materials were presented as individual packages to individual 
supervisors. Their responses to the pre-post tests as well 
as their comments were used as the basis for further revisions 
in b •> th audio and visual content prior to the two largo group 
validations. 

I 

Two large group validations were held, one in West Palm 
Beach, Florida, (December 1-5) with twenty science supervisors 
attending, and the second at Dickinson College, Carlisle, 
Pennsylvania, (January 5-9) with eleven science supervisors 
and college faculty attending. In both sessions all of the 
project material developed was presented without the use of 
any of the commercially available items. The first session 
(Florida) received the material in numerical order--Sets 1, 

II, HI, IV--and were given pre-post tests for All items 
presented. The results were positive for the material and 
strongly negative on both the testing and order of presentation. 
As a result, the Pennsylvania session had a changed order of 
presentation and far fewer pre-post tests. Programs for both 
sessions, sanple response sheets, and a brief summary of 
results are included in Appendix E. Set II materials were 
also presented as a unit to science supervisors in Boston on 
December 8, 1969. Various packages have also been presented 
to science supervisors participating in a science education 
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seminar at the University of Maryland. Summaries of the 
Florida and Pennsylvania sessions are included in Appendix E. 

The amount of validation on individual units varied 
depending upon the project production schedule. Some of the 
later sections, as indicated on the chart on the following 
pages, were not included in the large group validation 
sessions. The chart following, summarizes the validation 
activities. All of the final products submitted with this 
roport have been carefully revised on the basis of the 
validation Information. However, the revised material has 
not been validated. It must b*i emphasized that although 
fairly extensive validation has been cairled out on most of 
the material, more rigorous validation and more extensive 
field testing are necessary on both the pre-post tests and 
the mateiials, especially as a complete unit including all 
peripheral materials, There is a limitation to this activity, 
especially in the assessment instruments, because of the 
population using the materials. As relatively experienced 
prof ess ionals , science supervisors do not react favorably to 
the frequent and detailed assessment sessions necessary for 
rigorous validation. Individual reactions to single packages 
or 8 e t s indicate strongly that large group utilization of 
the materials in an ludtltute would lead to attainment of 
the objectives, both cognitive and affective. Ultimate 
validation, of course, will only be realized when the full 
array of materials is used in an institute of the type for 
which the complete set of materials was designed. Feedback 
from such an effort will suggest the degree of validity of 
the materials, and, perhaps more Importantly, provide the 
Inputs for further modifications and revisions. 

G. The revision of material, as has already been 
mentioned, was a continuing process responding to validation 
feedback. Revision was based on responses to content and 
the accompanying attitudinal posture. Failure in effective 
communication of content leads to decreased learning} im- 
provement of learning outcomes was the major objective in 
revision of project materials. However, positive interest 
and motivation were also vital considerations for revision. 

If the affective response As so negative that the participant 
rejects the rest of the program, changes in content and 
approach were obviously indicated. Cognitive and affective 
objectives are conceived a9 basic components in all materials 
produced . 
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VALIDATION ACTIVITY 
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All of the material has beon revlsod a minimum of two 
tiroes after the first "final" production as a result of 
staff and individual supervisor evaluation. Revisions woro 
mado after each validation activity shown on the chart on 
pages 11 and 12. Final revisions, both in content and style, 
were made just prior to this final report. These revisions, 
like validation, are not "final" in the ultimate sense. 
However, the materials do represent a finishod product 
applicable in their presont form for use with science super- 
visors. 

4 » 

H. Development of a management system for utilization 
of material is a key step in implementation in the educational 
technology process. Until the large group validations, any 
management plan was largoly theoretical . 

A basic tenet of educational technology is that a 
management system focuses on the individual learner. The 
system is structured to make full use of the materials 
available in such a way that the individual attains the 
specified objectives. 

Knowledge of the learner characteristics involved enabled 
the staff to develop an initial plan which utilized the 
materials in sequential order supplemented by additional 
peripheral material (chart in Appendix A, page 24). 

After the first large group validation, serious problems 
in regard to the appropriateness of the originally conceived 
sequence were discovered. The utilization of material not 
only needed to be more flexible, but most participants needed 
a better understanding of educational technology before U6ing 
any of the Set I material. This need for early understanding 
of educational technology as a process was re-emphasized in 
Pennsylvania where everyone conceived of educational tech- 
nology as machine applications to learning. As a result, 
there was semantic confusion everytine the tern was used. 

The final system proposed (Appendix A, page 25) incorporates 
changes indicated by the validation experiences. 

,To the best of available knowledge, the management system 
used for implementing the project materials in an institute 
provides an optimum approach to meeting individual participant 
needs within the limitations established by the amount of 
both project and commercial material available. 
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A fully complete validation of the system must wait 
until it can be tested through actual uao under conditions 
basic to the original conception of the project. As with 
the materials produced during the projoct, the systom does 
represent a functional product basod on a fairly high degree 
of actual objective experience using the processes of 
educational technology. 



Results and Findings 



The accompanying volumes • two through five, incorporate 
the results of this project. In brief, tho results are a 
complete series of refined, mediated material usable for in- 
service training of science supervisors. 

If the materials remain as they are in thia report, items 
to be read, rather than materials to be exporionced and 
shared by intense interaction with peers, the project materials 
will fail to achieve tho intended objectives. These materials 
have been developed and produced to bo utilized with and by 
science supervisors. The degree of utilization may vary 
with individual packages, but all of the packages must be 
used if the original objectives inherent in the project are 
to be realized. 



Conclusions and Recommendations 



Product l 

1. The project was successful in producing a series 
of usable materials for science supervisors both 
for inservice development of the supervisors them- 
selves and for use by supervisors to meet local 
training needs. 

2. The materials, although they have not been as 
rigorously validated as educational technology 
might demand, do represent a high degree of sophis- 
tication as a result of revisions based on both 
cognitive and affective changes in science super- 
visors who have used the material. 
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3. From the reactions of science supervisors, admin- 
istrators and others who have used the materials, 
the sets appear to have a general utility potential 
to meet the needs of all supervisors and should be 
revised to enhance their interdisciplinary appli- 
cability . 

4. The materials are of such a nature that final 
validation requires implementation of all sets in 
an actual operating institute. Final revisions of 
the materials, tests, and tnrnagement system should 
be made on the objective results obtained from the 
operation of such an institute. 

5. Full capitalization from the effort, time, and 
money invested in this project will depend on the 
utilization of the materials produced. The project 
was a practical activity leading to a usable 
product rather than a data gathering research in- 
ves tigation. 



Process s 

1. A project staff consisting of science educators, 
educational technologists, artists, and technicians 
had at the start characteristic and basic inter- 
disciplinary communication problems. The working 
combination with contrasting philosophies and 

sk 1 1 1 8 resulted in personal development of all 
staff members in addition to a successful develop- 
ment of materials. However, future projects in- 
volving a cross disciplinary team of this type 
could profit from the Inclusion of at least one 
generalist in all of the above fields in an admin- 
istrative capacity. 

2. Use of science *vpervisors as consultants intet- 
acting with materials as they are developed provides 
valuable revision information before presentation 
formats are fixed. It was found, however, that it 
is necessary to have evaluation based on the actual 
mediated material rather than in their printed form 
since the results are significantly different. 
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3. The use of simple media provided a number of 

unanticipated bonus factors: material could be 

easily revised; supervisors were not conditioned 
to linking machines with educational technology; 
and production ersts and timo were considerably 
less than with highly complex media allowing for 
more materials to be produced. 
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APPENDIX A 



OPERATIONAL CHARTS 
INITIAL/REVISED/JUSTIFiCATION 







INITIAL OPERATION CHART 
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REVISED OPERATION CHART 
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The individual has the 
option to choose any of 
the directions indicated 
including backwards. 



JUSTIFICATION 



During the first large group validation, it became 
obvious that the sequential method shown in the initial 
operation chart might result in cognitive learning gain 
but might also result in negative affective change. There 
are, however, two reasons, aside from the structure, that 
caused this. First, the presentations were made on a group 
basis. Second, the validation included use of the pre- 
tests before each presentation and post-test after. 

The presentation structure for the second large group 
validation (Carlisle, Pa.) changed the structure in 
directions requested by the first group (Florida) (chart not 
shown). As a result of these two activities and the arrange- 
ment of Set 1 1 1 8 present structure (diagram was not completed 
in time for the second large group validation) the chart 
shown on the previous page represents the revised operation 
chart. 

Although each set and each package within a set is an 
independent self-contained entity, the entire sequence of 
sets comprises a gestalt which requires structure of an 
operating system that will provide optimum affective as well 
as cognitive gain. In addition, participants entering with 
a concept of educational technology as machine application 
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found considerable difficulty until they were presented 
with an operating definition based on process. 

Introduction and orientation sequences were chosen with 
the above needs in mind: The Set IV kit has received con- 

sistent favorable response and represents, by its early use, 
a unifying link through all of the sets, developing a 
positive attitude. The choice of Toward a Definition as an 
educational technology orientation was made because the 
participant finishes that package with a working definition 
of educational technology as a process. 

The remainder of the diagram is a visual description of 
a learner's progress through the materials. With the 
guidance provided by the pre-post assessments, ami an under- 
standing of his own needs, the participant is free to utilize 
any or all of the material. 
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APPENDIX 6 



PROGRESS REPORTS 
CLIPPINGS 
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CONTINUING PROGRESS REPORT NO. 1 



EDUCATIONAL 

TECHNOLOGY 

PROJECT 



C onf Inu Ing 



Pfog<e* s 
Report 
no. 1 
Fob. 1969 



NATIONAL SCIENCE TEACHERS ASSOCIATION 
1201 Sixteenth Street, N.W., Wellington, D. C. 20036 
Areo Code 202-223-9400 



Tlic material will be arranged irt four sc Is 
of modules, Iwo directed toward orienta- 
tion and two toward implementation. 



Set A — Functions of Science Super- 
visors-fl’roblem Identification) 



This is the first in a series of Continuing Set ^ ~ function of Educational 'Iech- 
Progrcss Reports on the National Science nolog)'— (Learning Systems Theory) 

■Teachers Association Project officially titled 

• 'Set C — System Applications 



“The Development of Materials for the 
Training of Science Education Personnel 
in Educational Technology.” 

but for convenience to be referred to as: 
Project in Educational Technology. Copies of 
this report and subsequent issues may be 
obtained from the project office. There will 
be a charge for these reports — feedback. 
Space is provided for comments — reactions, 
suggestions, and questions. Two copies will be 
sent for each request so that one can be re- 
turi with feedback for the project staff. 



PURPOSE: This project has been dcsigred to 
meet a number of needs centering 
around the interaction of science super- 
visory activities and Educational Tech- 
nology applications. The terminal 
product will he a number of validated, 
self-instructional packages in our areas 
designed to meet specific objectives for 
science supervisors. 



Set D — Administrative Activity - 
(Management) 

Each module will contain a number of 
self-instructional units based on specifi- 
cally slated objectives. As a part of the 
project, each of these units will be 
structured, produced, tested on super- 
visors, and revised. Continuing inter- 
action with science supervisors will be 
maintained throughout each phase of the 
project, as well as during the validation 
activities. 



OBJECTIVES: 

1) To define the role of the science 
supervisor. 

2) To identify problems within these 
functions that can be met through 
tile application of Educational 'Tech- 
nology. 

3) To produce validated instructional 
material that will enable supervisors 



FEEDBACK to identify their own specific prob- 

lems and to structure possible solu- 
tions. 

4) To produce validated instructional 
material that will help supervisors 
develop skills necessary to utilize 
Educational Technology in instruc- 
' tion and management. 

f 

1 

PLAN: The specific activities of the project 
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(Continue on other ride if you need more (pace.) 



have been projected using a PERT type 
format and may be outlined in the 
following way: 

1) Identifying specific Objectives for 
modules and structuring Criteria 
Tests to measure attainment of the 
Objectives. (What outcomes are de- 
sired and how can they be 
measured?) 

2) Development of Pre-Test and Asses- 
sment. (What attitudes, back- 
grounds and concepts of their func- 
tions supervisors do have at the 
start of a module) 

3) Specify and sequence Enabling Ob- 
jectives for the module. (In detail, 
what steps must be taken to reach 
the desired outcomes?) 

4) Develop the instructional packages. 

5) Evaluate and revise the packages. 



THIS PROJECT IS FUNDED UNDER A 
RESEARCH GRANT ROM THE DEPART- 
MENT' OF DEALT. EDUCATION AND 
WELFARE-OFFICE OF EDUCATION. 
TITLE IV -PROJECT #8-0127. 




DIRECTOR: 

HERBERT A. SMITH, PHD. 
Associate Dean for Education 
Colorado Slate University 



CHIEF CONSULTANT 

GABRIEL D. OFIESH, ED.D. 

Director, Center for Educational Tech- 
nology 

Catholic University of America 



NSTA REPRESENTATIVE 

ALBERT F. EISS, PHD. 
Associate Executive Secretary 
National Science Teachers Assoc. 
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PURPOSE OF THE CONTINUING PROGRESS REPORT 



The first report was prepared as a brief introduct- 
ion to the NSTA Project in Educational Technology, Each 
|psuccessive report will try to fill three general purposes: 

j 1. Expand in greater detail on some area of the 

i project. 

2. Report on the progress of project activity. 

/ 

j 3. Provide a response to the feedback received as 

a result of the previous report. 
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\ We could call it a newsletter, but it is designed to 

'be more of a briefing and a report for those interested in 
:the Project rather than a set of news articles. Each report 
;will contain a 'feedback' section which will fold into a pre- 
ipaid, pre-addressed mailer. The information, reactions, and 
requests that are received have a very real purpose. They 
,show us the degree of interest in this project from a number 
iof areas and they also help to prevent our losing continuous 
'contact with the science personnel who are going to be the 
ultimate users of the materials we are trying to produce. 

The Progress Report is sent without charge, cost, or 
obligation to anyone who indicates an interest in the project. 
The feedback section provides a place to indicate whether o^ 
not you want to continue receiving these reports and another 
place for your name and address (with Zip Code) . 



Everyone receiving the Progress Reports either has an 
interest in the project (at least to some degree) and reads 
ff the report or couldn't care lesi? and dumps it in a circular 
^■file. We would prefer to eliminate the latter from the mail- 
| ing list - it wi)l save paper. 

!' 

H ' * 

8 
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INVOLVEMENT 



The only way the Project staff can keep from becoming Isolated 
in its own activity is to continuously interact with science 
education personnel. The Progress Reports provide the project 
with a means of talking about itself. The 'feedback' form 
provides people interested in the project with an easy method 
of reacting and requesting. In addition, as material is de- 
veloped, we hope to send out for trial and evaluation these 
packaged units. The only way to find oul if the material works 
is to try it out and on the basis of these trials revise and 
refine it in order to better attain the project objectives. 

Some people have already offered to work with us on this level 
and we intend making full use of this type of interaction. 

Your interest is enough to keep you on the mailing list - further 
interaction and participation is not necessary but will never 
be refused. As a side point - we need negative as well as 
positive reactions, whether anonymous or signed, but we find it 
difficult to send return letters to anonymous writers. 

RESPONSE TO SUGGESTIONS 



Reactions to the first of the Continuing Progress Reports were 
on the whole - favorable. The 'feedback' provided did determine 
the structure of this report which is designed to: 

A. Provide in greater detail specific outcomes desired for 
for the project. 

B. Define some of the vague terms found in the first report - 
keeping 'pedantic jargon' to a minimum. 

C. Specify in detail the purposes of the Progress Report. 

D. Specify the role we would like those receiving the reports 
to have in the project. 

E. Present the present status of project activity. 

STRUCTURE 

The full title of this NSTA Educational Technology Project is 
"The Development of Materials for the Training of Science Edu- 
cation Personnel in Educational Technology." The general goals 
of the project are well stated by the full title. 

The materials being developed have been grouped into four oasic 
areas or Sets. 

SET I - ROLE OF THE SCIENCE SUPERVISOR 

Presentation of the broad activities of the Science 
Supervisor /Consul tant seeking a positive attitude 
toward reevaluation and possible extension of the 
supervisors present activity. 

INTRODUCTION TO EDUCATIONAL TECHNOLOGY 
Offering an operating definition for Educational 
Technology and an exposure to the process and methods. 
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SET II - 
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SET III - APPLICATION OF EDUCATIONAL TECHNOLOGY 

Development of understanding and skills necessary 
to utilize Educational Technology in preparation 
of a learning system. 

SET IV - MANAGEMENT 

Transfer of the skills developed in the previous 
set to other supervisory areas such as budget pre- 
paration, proposal preparation, and other manage- 
ment arcati . 

These areas or Sets are slightly different in wording from the 
first Progress Report and represent a refinement in our thinking. 
Greater expansion on what specifically is to be done in each 
set will form the major content of the next progress report. 

PLANNED OUTCOMES 



Each of these sets will be composed of a number of self-contained 
instructional packages containing specific (behavioral) objec- 
tives, criterion tests, learning materials (books, slides, audio 
tapes, or whatever format used), and instructions. In addition 
to the basic instructional packages being developed for each set, 
there are two types of supporting material beirg prepared. For 
the most part this supporting material represents already 
available 'off-the-shelf' items which will serve to represent 
different content or to extend in greater depth specific content 
areas within a set. 

As far as possible, all material will be self-instructional in 
nature and can be used by an Individual or small group. Each 
package as it is developed will be tried out (validated) on 
science supervisors and revised on the basis of whether or not 
it accomplishes its stated objectives. Each package will be 
validated and revised individually - the entire set will be 
validated and revised as a unit. 

These validated and revised materials are being designed specif- 
ically for the Science Supervisor/Consultant. Since each 
individual package is self-contained and meets specific objectives, 
there will be a considerable amount of material that s super- 
visor can use in work within his local area. For example: A 

package on evaluating and preparing instructional (behavioral) 
objectives, although it is written for the Supervisor, will most 
likely be useful for the teacher within a local school. 

DEFINITION OF TERMS 



Science Education Personnel - We are preparing materials specif- 
ically for Science Supervisors. Within this very broad desig- 
nation, we include personnel whose major responsibilities in- 
volve the science program, its development and implementation, 

8nd the teaching staff necessary to carry out the science program. 
This activity may be carried out within individual schools, 
intermediate units, or on state levels. Titles for this type 
cf person range through Supervisor, Science Department Head, 
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Science Advisor, Science Consultant to Science Administrator. 
Although the materials are designed for this group, by their 
very nature many of the packages produced will be widely appli- 
cable outside of the original population group. In some of our 
initial validation activity, classroom teachers were involved. 

Self-Ins tructional Packages - These are complete learning 
packages containing full implementation and evaluation infor- 
mation and a multi-media learning presentation. They are de- 
signed to be used either by an individual or small group with- 
out the need for a leader or instructor being present. 

Educational Technology - It is a process approach to learning 
that utilizes learning theory, a systematized approach, and 
instructional tools f r on human to machine developed to produce 
specified learning within an individual. 

The above definition must be considered a general working 
approach for those who have requested it. Educational Technology 
is a process whose product is learning. Presenting a concise 
and brief definition would be similar to defining the chemical/ 
physical process involved in the production of rayon. 

A full definition will represent the content of a major portion 
of the Set II material. 

PROJECT PROGRESS 

Set I - All of the initial scripts and visual specifications 
have been finished and initially validated with individual 
supervisors. Revised scripts and a more finished form of 
artwork are in preparation and should be complete within 
three weeks. The criteria tests and implementation handbooks 
ure being developed and have the same target date for completion. 

Set II - Initial scripts are almost finished and initial story- 
boarding is in process. As soon as these are complete they 
will be given to a number of supervisors for first validation. 
Within five or. six weeks the first revisions should be complete. 

Sets III and IV are both in the process of being specified and 

specific objectives (behavioral) are being revised. Scripting 
should begin within two weeks. 

Support Materials are being identified. A crew of graduate 
students have been searching, reading and abstracting reports, 
catalogs, and research in every area that might provide support 
to the program. 



THIS PROJECT IS FUNDED UNDER A RESEARCH GRANT FROM THE DEPART- 
MENT OF HEALTH, EDUCATION AND WELFARE - OFFICE OF EDUCATION. 

TITLE IV - PROJECT #8-0427 
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NSTA NEWS-BULLETIN 



OCTOBER 1969 



Educational Technology Project 

The NSTA Educational Technology Project is develtping instructional 
packages for use with science supervisors. These instructional mils are 
grouped into four areas or sets of packages: a) Role of a Science 
Supervisor, b) Introduction to Educational Technology, c) Application of 
Educational Technology, and d) Management. 

Although the design of the entire project is to develop skills for the 
understanding i,nd implementation of Educational Technology in various 
supervisory areas, the material has wider application. Each package within 
a set is a self-contained unit. As a result material can be utiliicd on a local 
level by supervisors for ioservice development programs and administrative 
briefings. ’ 

All ol the Set I and hall of the Set II packages have been completed and 
are presently being reviewed by both supervisors and teachers. The rcsulis 
of these activities will provide the basis for revision ana final production ol 
materials. 

The project issues a periodic Continuing Progress Report which contains 
a feedback mailer used to allow anyone interested to respond and to 
participate in project activity. Copies of this report are free and may be 
obtained by w riling or calling the project office: George H. 7 : encr, Project 
Administrator, NSTA, 1201 Sixteenth St , Washington, D.C. ,0036 
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NSTA NEWS • BULLETIN 



FEBRUARY 1970 



ED TECH PROJECT 

IS over; TWO 

WORKSHOPS HELD 

The Educational Technology 
Project, which NSTA conducted 
during the pail two years, will 
terminate February 2$. Material! 
Jiave been produced which relate to 
problems faced by the icience 
supervisor: his duties and how to 
plan his work effectively, the nature 
of educational technology and its 
purpose in education, how 
educational technology can be 
applied to the '»ipervisof*i 
problems, and a simulated problem 
where the supervisor actually 
applies the principles to analyse his 
most impoitant projects. 

Two workshops have been held 
with science supervisors to review 
the NSTA educational technology 
materials and make suggestions for 
future use. The first workshop, in 
Palm Beach, Florida, on December 
l»$, attracted 16 supervisors from 
various regions of the slate. Florida 
State Science Supervisor James A. 
Moore arranged the meeting. 

In Carlisle, Pennsylvania, the site 
of the second workshop, a small 
group of supervisors renewed the 
educational technology material 
and visited the Dickinson College 
observatory and planetarium. The 
workshop, which also included a 
demonstration of computer 
programing via telephone, was 
arranged by James McDermott, * 
science consultant for Pennsylvania. 

As the Educational Technology 
Project nears completion, NSTA is 
considering the nett steps in rinding 
ways to male the materials that 
have been developed available to a 
wide autfietrce of supervisors and 
others involved in curriculum 
change. 
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APPENDIX C 



RESPONSE SUMMARIES ON PROGRESS REPORTS 



3l 




The responses to the first Continuing Progress 
Report totaled 85. Samples of some of the feedback 
received are included in the following pages. In 
general, response was favorable toward the project 
and either neutral or negative toward the format 
and presentation in the progress report. 



Statistical Report 



Number of replies: 


85 


Number of comments listed 
In this report: 


32 


Number of additional people 
interested in doing some 
evaluation work: 


28 
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COMMENTS OF PERSONS RESPONDING TO THE FIRST PROGRESS REPORT 



A. FAVORABLE 



Sounds good. Where can I obtain a copy of your original 
proposal or other document that describes more precisely the 
kinds of Educational Technology to be employed. From my 
vantage point it appears that the local, 'science supervisor" 
role varies from that of being a traveling science teacher 
to that of "director of science" with major administrative 
responsibilities. I hope this project effort will meet the 
nends of this diverse group. 

Larry McKown, Science Consultant 
Battle Creek Public Schools 
Battle Creek, Mich. 49017 



This looks like a very useful research study. One that could 
be of use to new supervisors. I would like to review in more 
detail the plan part of the program. Thank you for informing 
me . 



Edward J. Flannery, Science Supervisor 
Council Bluffs Public Schools 
207 Scott Bluffs, Iowa 51S01 



Your project sounds tremendously exciting and I should very 
much like to participate. I am currently developing Audio* 
Tutorial Systems in biology and am keenly Interested in 
educational technology. 

Mrs. Jane Abbott 
Science Department Chairman 
Waterville High School 
Watervtlle, Maine 04901 

t 9 



Would be very much Interested in purchasing copies of report 
when available. Please keep me Informed. 



James K. Montague 

619 Washington Street #5 

Coventry, Rhode Island 02816 



I am definitely Interested and wish to participate in the 
continuing reports. If Set B and Objectives 2 and 3 together 
mean that this project should develop Insights and skills which 
will enable the supervisors to maintain flexibility and enable 
him to change with altering conditions so he can hopefully 
attack and solve new problems or Incorporate new techniques, 
then I feel the project goal Is worthwhile. 1 do not feel a 
■development of solutions to presently known problems would have 
any long-term values. This latter approach would make the 
project self-perpetuating. 

William R, Peterson, Science Supervisor 

2206 Grandview Blvd. 

Sioux City, Iowa 51104 

As 1 read about the project It sounds great, but, I always end 
up wondering just what you mean by ''Science Supervisor". I 
taught science In >,he mid-west for 10 years, there we considered 
the state department men and the college specialists as the 
"Science Supervisors". How here In Mass, we have a state 
association of science supervisors - In reality It Is made up of 
high school science department chairman and Interested college 
science educators. Perhaps there are other kinds of science 
supervisors - who are you aiming at with these- materials? ?? 

Dr. Donald Schmidt, Biology Dept. 

Fitchburg State College 

Fitchburg, Mass. 01420 



An excellent Idea that should prove beneficial to both myself 
and to the department. A clearer definition of "Educational 
Technology" should be provided. What Is the cost? Who Is to 
bear the cost? How many tests? How often are testo administered? 
How much time will be required of each participant? I am willing 
to participate. 



Hr. Bdward Thompson 
Coordinator of Science 
Board of Education 
City Hall 

Elisabeth, Hew Jersey 



Reaction to the project - great. 1 want to be certain that 1 
remain In contact as It progresses. Will be quite happy to 
react as it goes along. 



Anthony Bleecker 
Dean of Science Instruction 
Pennsbury School District 
Fsllsington, Penna. 19054 
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Is there to be a questionnaire requesting opinions on the 
various points? Or how Is the Information and the necessary 
conclusion (s ) to be decided? What is the definition cf the 
science supervisor for the purpose of this study? Does it 
include department heads, chairmen, consultants, etc.? 

Edmund F. Frankowski 
Mather Junior High School 
Darien, Conn. 06820 



This is a much needed project, and I shall bo interested in 
receiving all subsequent issues of reports on it. I agree 
that science supervisors must be aware of the applications of 
Educational Technology, because it is certainly one answer to 
some of the major problems in education today. 

Mrs. Shirley Brewer 
Coordinator of Secondary Science 
Spring Branch I.S.D. 

955 Campbell Road 
Houston, Texas 77024 



I am looking forward to receiving the next "issue" of these 
reports. It looks to me like you have a good thing going. 

I wonder what role I can play, what contribution I can make. 

David Engleson 

Department of Public Instruction 
126 Langoon Street 
Madison, Wisconsin 53172 



1 am most heartened by your recent proposal aimed at solving 
present or potential problems of the science supervisors. I 
would be most pleased to become a member of your project and 
would welcome any opportunity to assist in any way possible. 
Certainly the area of science supervision is a complex one 
with its varied disciplines and laboratory techniques, and, 
in many ways one of the most demanding positions in the public 
school setting. 1 look forward to continued correspondence. 

Thomas W. Eastman 
Director of Science 
58 Hawthorn Avenue 
Meedham, Mass. 02192 
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Tallahassee, Florida 32304 



I will be very interested ir. the progress of this project. It 
covers an area which is of prime importance at this particular 
time in view of t lte rapid changes which are occuring in science 
education. If there is anything we here in this school system 
can do to assist the project, please feel free to call on ua . 

I will be most happy to help any way I can on an individual basis. 

J. B. Tuck 
Science Supervisor 
Bolivar Public Schools 
Bolivar, Missouri 65613 



I am Interested in the Project in Educational Technology. Due 
to the increasing cost of education and the shortage of teaching 
plus the nerds for Individualisation the project is highly 
pertinent. He hope to be Included in your distribution. 

John Hanspeaker 
Supervisor of Science 
Charles County Board of Education 
La Plata, Harylend 20646 



An excellent and needed program. On the basis of the wide 
variety of assignments in K - 12, and the segmented units of 
responsibilities, this could be a rather extensive program. I 
sincerely hope that the format for '’Feedback" is such that the 
respondent can conveniently place it in a typewriter so the 
tabulator of information does not have to read handwriting as 
bad as or even more like an M.D. 's than mine. 

B. Stanley Melick 

Science Department Head 

Shaker Heights Senior High School 

15911 Aldersyde Drive 

Shaker Heights, Ohio 441’0 
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The basic Idea Is a good one and I am pleased Chat you are 
working on It. Please send me copies of future reports. 

Glenn D. Berkhelmer 
2208 Heritage Avenue 
Brlarwood 

Okemos » Michigan 48864 



This project will be followed willingly and closely. Thank you. 
Your first objective, If net, will give greater Impetus to 
science supervisors whose role definition is anything but clear 
In some Instances. I feel the advent of the non-graded approach 
and other innovative procedures In the total educative endeavor 
has created a need for knowledge of these methods and materials, 
sources of information, etc. on the part of supervisors which It 
1 8 very difficult for them to obtain - given the fact that many 
are occupied on a full time basis. Perhaps It Is a worthless 
suggestion but I know that It Is almost impossible to obtain 
grants for supervisory Institutes for elementary science super- 
visors. Is there some way In which technology can Improve this 
situation? How synonymous are these terms: (in regard to science 
educators?) Specialists, Coordinator, Consultant, Supervisor, 
Teacher. A questionnaire would perhaps reveal some startling 
news . Thank you again. 

Sister James Helena Nadeau 
Science Supervisor, Title I Enrichment 
Proj ect 

160 Seabury Street 
Fall River, Mass. 02720 



An excellent design for meeting a rather obvious need. 

David H. Ashby 
Science Supervisor 
3210 Campus Drive 
Dayton, Ohio 45406 



An ambitious and a necessary project. I am excited at the 
possible outcomes. 1 would hope that more Information end detail 
would be made available soon. 1 volunteer to do anything I can 
do to help. 

K. 0. Campbell 
Science Department Chairman 
West Morris High School 
Chester, New Jersey 07930 
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Please Include me Co receive future reports. At this point I 
feel so far behind In applications of Educational Technology to 
supervising that I haven't anything to feedback. Will try to 
Improve as materials arrive and can be digested. 

Dr. H. C. Donohoe 
Chairman, Biology 
Mercer County Community College 
Trenton, Hew Jersey 



Comment on role of the Science Supervisor in Iowa Intermediate 
Units (RESA) Regional Educational Service Agency. As a Science 
Consultant ( not Supervisor) , I see myself providing the following 
services to the 9 school districts in our merged County area) 
a) Promote In-service workshops, b) Share information concerning 
material, methods and programs. c) Assist with the articulation 
and development of K-12 Programs. d) Assist in developing 
resource units, e) Promote curriculum Implementation and 
Research for professional, exemplary curriculum practices, g) 
Evaluate Instructional equipment and material, h) Investigate 
and assess major issues and trends in Science Education. 1) 

Assist professional personnel, identify problem areas and suggest 
alternative proposals for solutions. My goal is to assist 
professionals in our local school districts, provide QUALITY 
Science Education for all students. 1 attempt to provide the 
leadership role so necessar) for the developing and maintaining 
of a top-flight science program. I feel that my particular 
position is unique and a "step into the future" in dealing with 
Educational Services. Utilizing the merged area concept, quality 
assistance can be as available to the smaller ochool district and 
as effective with the larger districts. I will forward a brochure 
describing our school district and my particular department. 

Joe R. Moore 
Science Consultant 
330 B. 4th Street 
Area IX 1MC 

Davenport, iowa 52801 



This appears to be a very ambitious but useful project and 1 
would like to be informed on the progress of the project. Do > ou 
have any collateral readings or specific references which might 
give me a better basis for understanding the nature of the project? 

Joseph F. Walsh, Jr. 

270 North Main Street 
Cohasset, Mass. 02025 
Science Supervisor 
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,B. OPPOSED TO FORMAT OF PROGRESS REPORT 

Please omit the jargon, i.e. whats a module, PERT, packages, etc.. 
Don't turn me off because I don't read your lingo. Now "what 
outcomes are desired and how they can be measured" - Is plain 
talk for a great void in our business - fancy talk really doesn't 
impress people who work at this. To involve supervisors in 
extending their influence seems a worthwhile end to pursue - if 
other educational ends (non-science) are kept in focus. If the 
supervisor "interacts" with Ed Technology "applications" 1 read 
that I become involved in taking a look at something I'm doing - 
yet there is interaction between me and someone else - who? 

Final comment ... When do I find time to become involved in this? 
Summers? I am a Jr. High chairman, a degree candidate, a father 
of 2, teach 3 classes and supervise 7 teachers. It's difficult 
for me to understand HOW you are doing what seems to be a need 
thing. 



David I. Kronenberg 
156 - 11 Aguilar Avenue 
Flushing, New York 11307 



'Perhaps this first Progress Report is deliberately vague. How 
do you define educational technology for the purposes of this 
project? Perhaps this would help lie. If we are to effect change 
from the "research" phase through to dissemination in less than 
the usual fifty years, this project should be most valuable. Best 
wishes for your success. Call on me, please, if I can be helpful. 

Max Berzofsky 

Science Department Chairman 
Loch Raven Jr. High 
8101 LaSalle Road 
Towson, Maryland 21204 



Sorry, this material is almost obsolete in terms of observable 
behaviors. Cannot react in any meaningful way. 

John G. Read 
Scierice Supervisor 
17 Chestnut Street 
Sharon, Mass. 02067 



So you want Feedback. Well, here's some. Just what kind of 
feedback did you want on Report #1? You failed to Identify the 
immediate action, behavior, or performance you wanted at this 
point. Either you failed to analyze the first feedback loop in 
this project and include proper input into it, or you outdid 
yourselves in your analysis anticipating just this type of reaction. 
'I am not certain whether you wanted any feedback or not. But if 
'you wanted feedback, on what did you want it? Do you want overall 
reactions? Do. you want a reaction to the Purpose? (1 highly 
doubt that since it was probably stated in the grant proposal 
and is not likely to be alterable under any circumstances until 
later in the project.) Do you want reaction to the Objectives? 

(I doubt that also for the same reason.) Or do you want comments 

on the Plan? (I doubt that also as it would be nonsense to alter 

it before it is undertaken.) Or do you want help at this point 

on step one? In the. absence of specific behavioral programming, 

I will react generally, and say the project is needed and I 
want to be a part of it; so keep me on the mailing list. I hope 
my ‘above analysis is not too harassing and may provide you with 
a lighter moment during your tracking of sub-sub-system no. 1 
That at least, is its intent. I will try to be more helpful 
on interaction of No. 2. 



Jerry M. Colglazier 
925 S. Pasadena Street 
Indianapolis, Indiana 46219 



The covering letter mentions that "the outcomes" of the project 
should be very useful to science supervisors, but nowhere does 
the booklet tell us exactly what those outcomes are or will be. 
What are "science education personnel?" ...students? teachers? 
supervisors? textbook writers? media developers? administrators? 
The term is too vague. Be specific. What needs? Again it 
would help if you were specific. Is a module a package? Why not 
choose a name and stick with it? What do these materials look 
like? Booklets? Micro-fiche? Films? Will they be some sort of 
programmed material? It would help if you were more specific. 

Does specifically stated objectives" mean behavioral objectives? 
The objectives listed below are not of much use. They are not 
8 tated in behavioral terms and much too vague. It might be a 
.good idea if you asked science supervisors what the objectives 
ought to be. What do they need most? Should I assume that 1) 
refers to Set A, 2) refers to Set B, etc.? If not, what does 
the functions" in 2) refer to? Those mentioned in Set A or those 
in Set B? or to some other functions? Objective 1) nound like a 
waste of time, but of course it is so vaguely stated that I am 
not really sure what is meant. It sounds like something we have 
all met in most of our deadly dull education courses. Objective 
2) sounds like it might be more interesting and useful, if only 
I knew what functions you were talking about. Objectives and 
4) sound great. Something like this is really needed. The plan 
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Continued next page 
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Since some of the pedagese used thruout this brochure has been 
translated via parenthetical statements, a definition of 
Educational Technology is necessary. 

H. Lloyd Burghart 
Science Supervisor 
Wainwright Street 
Ipswich, Mass. 01938 



It appears that this may develop into a valuable service for 
supervisors. I trust that it will be concise, meaningful, and 
will change behavior. 



George N. Cataldo 
Science Supervisor 
138 Walworth Road 
Ontario, New York 14519 



Might not Set B and C ‘precede Set A, so that the contemporary 
theory and application ,‘uld be used in problem identification? 

Dr. Clarence W. Gehris 
Dept, of Biological Sciences 
State University College 
Brockport, New York 14420 



I dor 1 1 understand everything you have written here. Will it be 
clarified? If your objectives are reached, and I can be a better 
supervisor through using the materials which are developed, I'm 
all for it. Count me in. 



Lawrence J. Buford 
Science Supervisor 
6518 Laird Drive 
Austin, Texas 78757 

I am interested in receiving reports of this project as it 
progresses. You have not indicated the charge for these reports. 
Will a subsequent issue contain this information? 

Mrs Catharine Y. Bonney 
Science Supervisor 

Newark Special School District Box 360 
Newark, Delaware 19711 
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The responses to the second Continuing Progress 
Report totaled 350. Samples of some of the feedback 
are shown on the following pages. In general, the 
response to both the project, its activities, and 
the report ranged from favorable to enthusiastic. 



Statistical Report 

Number of replies: . 350 

Number of comments listed 

in this report: 32 

Number of additional people 
interested in doing some 
evaluation work: 185 
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COMMENTS OF PERSONS RESPONDING TO THE SECOND PROGRESS REPORT 



second report must He commended for its organization and 
simplicity. The first report left me a little cold, perhaps 
because I thought that this project looked like one of the 
typical ones that might never get off the ground and probably 
would be of little value to many. I am happy to see that you 
are moving so rapidly on the project. Keep up the good work. 
I'll be interested in seeing the first Set. 

Lloyd tl. Lundberg 
Assistant Principal 
Proviso Fast High School 
Elmhurst, Illinois 60126 



In my role as a consultant to the many school districts which 
participate in ERCA I encounter many of the problems which the 
, Educational Technology Project was designed to clarify. I 
would be most anxious to see if either of these two sets could 
ease any burden with the supervisors in council schools and of 
course be delighted to provide feedback information for the 
project . 



Fred Rasmussen 
Research Associate 
Educational Research Council 
of America 

Rockefeller Building 
Cleveland, Ohio 44113 

Are any of the materials available- to us now? If so, please send 
Set I materials. They v/ould prove helpful in reevaluating my role 
in the local organizational structure. 

Marjorie M. King (Miss) 

Science Consultant 
Jefferson Parish School Board 
519 Huey P. Long Avenue 
Gretna, La. 70053 
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On August 30th I shall be moving to the University of Southern 
Mississippi at Hattiesburg to become an Assistant Professor of 
Science Education. There we shall be in an ideal position to 
conduct some evaluation work. Science Supervisors are new to 
the State of Mississippi. Until recently, I was the only science 
supervisor in the entire state; therefore, there needs to be a 
massive influx of information on the role of the supervisor. 

Your project can be the agency that does Just that, and we need 
all the help possible. The University of Southern Mississippi 
has the only Department of Science Education in Mississippi and 
this institution is doing much to promote science education in 
this area. We shall be in a strategic position to conduct some 
of the research for the Educational Technology Project. 



Dr. Bob E. Craven 
Supervisor of Science 
Leflore County School District 
Route 1, Box 204 
Greenwood, Miss. 38930 



Some of my students are "beginning" science supervisors and/or 
administrators. I would like to try materials with this group. 
Also a new college course in Elementary School Science Supervision 
is currently developing and would like to evaluate Sets with this 
group as pre and in-service program. 

John H. Settlage 

Professor of Science Education 

N.M.S.C. 

Kirks ville , Miss. 63501 



I am the president of the Association of Science Department Heads 
of Eastern Massachusetts. If we, as a group, can be of any help 
to you, I wish you would inform me as to how we can aid you. We 
meet ten times a year starting in September. The Association 
consists 'of 28 supervisors of science. Some of our members are 
Department Heads of High Schools, others are Directors of Science 
from K-12. All our members have supervisory duties ranging from 
.K-12, 7-12 to 9-12. I hope we will be able to assist you in some 
manner. 



Samuel F. Gregory 
Director of Science 
Stoughton Public Schools 
232 Pearl Street 
Stoughton, Mass. 02072 
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The University tf Wisconsin-Green Bay is making full use of 
educational technology where appropriate and where possible. 

We plan to include in our teacher preparation program instruction 
appropriate to develop competencies for the wise, utilization for 
the usual instructional aids and the computer as a management 
tool. This latter area has particular relevance to area schools 
N and would be the basis for a very strong research project. 
Specifically, we would like to investigate techniques whereby 
achievement in the sciences can be systematically monitored by 
the classroom teacher and the resultant data cataloged by 
computer. The creative aspect comes in the analysis of these 
data when various diagnostic statements can be produced for the 
teacher, to keep her alert to strengths and weaknesses in 
.achievement for each student in her class. We hope to see a 
project of this sort develop, and hope to obtain some sort of 
funding within the ne«t year. 



Dr.' George T. O'Hearn 
Chairman, Division of Education 
University of Wisconsin-Green Bay 
1567 Dackner Avenue 
Green Bay, Wisconsin 54302 



We are principally a teachcr-educating institution. At the 
present time we are involved in an NSF-COSIP Project aimed at 
improving our preparations of science teachers, primarily for 
the secondary schools. I am director of this modest Project, 
and would be glad to share with you any appropriate over-lap. 

Dr. Charles E. Walker 
Chairman, Division of Science & Math 
Valley City State College 
Valley City, North Dakota 53072 



Continuing Progress Report #2 certainly brought this whole 
project into sharp focus and it's aims are realistic-Very. 

Whatever I can do to further the project I am willing to try. 

The developed "Sets" that will be developed could be of value. 
Presently, I am conducting a summer workshop using "Guide for 
Inservice Instruction" by AAAS for "Science - A Process Approach" 
and find that introducing "The Process Approach" by actually 
having teachers "DO" the exercises provides meaningful and lasting 
sessions. Hopefully, the Educational Technology Project would 
turn to teacher involvement approaches. 

Dr. Robert D. Littlefield 
Science Curriculum Coordinator 
Oxford Hills High School 
Main Street 

South Paris, Maine 04281 



# 
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The brief explanations and definitions are much appreciated. 
Further development in depth will throw more light on the project 
for those receiving the C.P.R. I wonder whether persons in the 
Science Supervisor/Consultant category may in their own minds 
think that they are f air ly -we 1 l-vers ed in the aspects of Sets I, 
II, III, IV. From another point of view, however, well-planned 
"packages" can be most useful for ready reference and ready use 
with professionals under the supervision of the Supervisor/ 
Consultant. Good luck in this Project. 

Robert N. Nelson 
Chairman Secondary Science 
Went Islip Public Schools 
40 Alinda Avenue 
West Islip, N.Y. 11795 



I am also a part-time Educational Consultant to some Hospitals 
for in-service programs and am very interested in your Set II - 
Set III. For many reasons there has been a tremendous lag of 
"modern" educational methods, etc. and filtering into the medical 
field. I have been to several regional meetings, the work-shop 
in Las Vegas on Behavioral Objectives an! continually share all 
the material with my teaching colleagues. 

Dr. Mary E. Heatherman 

Biological Consultant 

San Francisco College for Women 

2002-36th Avenue 

San Francisco, Calif. 94116 



It seems your Set I materials would be beneficial to me in program 
planning for this fall. I dsn't know if your methods include 
using university level supervisors in pre-service teacher training 
courses, but at any rate, 1 still am most interested in the 
materials for se lf-educat ior al purposes. 

Vince Mahoney 
Science Supervisor 
University of California 
School of Education 
Berkeley, Calif. 94720 
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How can a person get involved, trial and evaluation, only? 

Are you considering a set on Computer Based Instruction or 
Computer Assisted Instruction using teletype terminals and a 
shared time program? 

Norbert J. Konzal 
Science Consultant 
Phoenix Union High School System 
2839 W. Solono Drive N. 

Phoenix, Arizona 85017 



Thank you for making Report ft 2 more readable. The "pedantic 
j ar S o n" of the first report left me cold. Now I have a better 
’feel" for what you are trying to do. It might be of interest 
to know your tentative time schedule. Is this a five year 
project? Two year? Continuing indefinitely? 

Robert G. Gorton 
Science Coordinator 
New Providence High School 
New Providence, N.J. 07974 



Report No. 2 was more intelligible than No. 1. Thank goodness! 
Keep it clear and intelligible. To reach a meaningful audience 
the material must make sense to the un-ini tiated . When and how 
may the Sets be seen and studied? 

r 

Nicholas Sturm 
Biology Department 

! Youngstown State University 

140 Baldwin 

Youngstown, Ohio 44505 



So far it seems that this project is geared to the High School 
level. I would like to see and hear more about collegiate feed 
back - if any. 



Miss Patricia Grzybek 
Villa Maria College 
240 Pine Ridge Road 
Buffalo, New York 14225 
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This project fascinates roe. The explanations in your "progress 
reports" are confusing and v/ritten in such language that I still 
can't determine what it is all about. The elapsed time (January 
to July) of reports is so long that I forget about th ft - project. 1 
could find nothing in the NSTA annual convention program at Dallas 
abojt this project and could find no one who knew anything about 
it. i wish that just one "progress report" would state in simple 
language what you plan to do and how you plan to do It some- 
thing concrete. Keep me posted. 

Lawrence Buford 

Coordinator - Secondary Science 
Austin Independent School District 
6100 N. Ouadolupe 
Austin, Texar 78752 



The first page and one half of the Progress Report No. 2 was re- 
dundant and had much 'pedantic jargon'. The last two and one half 
pages were specific and to the point - 

Edward L. Frazier 

Chairman, Biological Science Dept. 
Speedway High School 
5007 W 14th Street 
Speedway, Indiana 46224 



The information in the Continuing Progress Report h T o . ?. was 
essentially a vague series of catagorical statements. One has no 
idea of the content or significance of what is being done. Hope 
the next report will be more npecific and informative. 

Dr. John C. Harnett 
Chairman, Biology Department 
St. Michael's College 
Winooski, Vermont 05404 



Definition of "educational technology 1 ’ is weak. The part about 
it's being a "process approach to learning" is confusing. "Process" 
in science education, usually denotes a factor among t e processes 
of science. Do you mean "active" or "involvement of individual"? 

Victor Showalter 
Research Associate 
Educational Research Council 
Rockefeller Building 
Cleveland, Ohio 44113 
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Educational Technology Project as described could have a very 
direct impact upon students. A learning system is a goal of all 
science supervisors. Is the goal of the project to provide a 
framework that the supervisor can use to develop a learning 
system? Is the project designed to increase science supervision 
ins tructior.al development activities? Is the project itself a 
model system?' - 



Stephen Rituper, Jr. 

Curriculum Coordinator 
Bethlehem Area School District 
1330 Church Street - Education Center 
Bethlehem, Penna. 18015 



I hope I understand correctly from your Progress Report C2 that 
the packaged set materials after they have been initially tried 
and evaluated will be available to people on the project mailing 
list. I am looking forward to receiving the first package of 
these materials . 



Robert J. Lexow 

Associate Dean, Science & Math 
Milwaukee Area Technical College 
16760 Burleigh Place 
Brookfield, Wisconsin 53005 



Carty over into the college relations committee of NSTA looks 
good] Many college science department heads and Dean3 could well 
benefit from these packets. College instructors in General 
Education Science courses could benefit from • evaluation of course 
objectives, since these courses provide training for elementary 
education majors. 

Glenn H. Crumb 

Kansas State Teachers College 
Research & Grants Center 
Emporia, Kansas 66801 



This appears to fit in very well with a 5-year program we’re 
developing with local school district cooperation, for elementary 
science personnel. Hopefully, with UPSTEP funding. An active, 
practical internship would be our core around which classes and 
laboratory would revolve after the first 2 years of liberal arts. 

Dr. Clarence W. Gehris 
Associate Professor 
State University College 
Brockport, H.Y. 14420 
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I am very interested in an involvement in this work you are doing. 
I am particularly interested in behavioral objectives you have 
indicated. We are working as usual on in-service training project 
and curriculum evaluation and changing. Your work seems to be 
something which I can directly use to a great advantage. 

Harry C. Hewett 

Head, Sciance Department 

Gallup High School 

Boardman Avenue 

Gallup, New Mexico 67301 



Definition, .limitation, and execution of duties of science super- 
vision is long overdue. Each school board, administrator and 
supervisor has his own definition, etc. of what a supervisor is 
and how he should operate. 

Robert L. Sampson 
Head, Science Department 
Central Grammar School. 

207 Granite Street 
Rockport, Mass. 01966 



The actual content of the materials included in each set is 
vague. Although all presons having anything to do with this area 
of science education have ideas and/or responsibilities having 
to do with their particular position your report is still vague 
as to what you would define as the vole of the science supervisor. 
A more complete outline of the content of each "Set" would be 
most helpful. What you are attempting to accomplish is good and 
will prove vital to us in the field. It will fill a much needed 

Phillip A. Popplrton 
Chairman, Science Department 
Rnumclaw Senior High School 
Route 2 - Box 610 

Bnumclav, Washington 98022 



58 



VALIDATION QUESTIONAI RES 



There are three separate validation 
forms included in this appendix. 
These assessments wero used in 
addition to the pre-post tests for 
the individual packages. 

The first form was used with in- 
dividual science supervisors on 
individual packages prior to the 
large group validations* 

The second and third forms were 
used for the two large group val- 
idations that included all of the 
packages complete up to that time. 



EDUCATIONAL 

TECHNOLOGY 

PROJECT 




criterion assessments 

FOR SINGLE PACKAGE EVALUATION: 
INDIVIDUAL VALIDATION 



NATIONAL SCltNCC TEACHERS ASSOCIATION 
1201 Sixteenth St.. N.W.. Washington. D C. 20036 







PRESENTATION QUESTIONAIRE 



CONTENT : 

1. Write (discuss) the content of the presentation you 
just received, including comment on the following 
specifics : 

A. Amount - was there enough information, too much, 
not enough (too specific, too general)? 

B. Organisation - did the content follow a logical 
sequence, was it dear, was it confused? 

C. Relevance - did it convey an understanding of 
your responsibilities as a science supervisor, 
was the information presented useful? 

MEDIA: 

1, Comment (write or discuss) the media of the pre- 
sentation you just received with specific reference 
to the following: 

A. Type (slide-tape) - would you use the same media 
in conveying the content, cr othef media? If 

you would use other media, for instance, video- 
tape movie, what kind would you use? 
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B. Effectiveness - vis the media used effective 

in conveying the content? Indicate points you 
thought most effective, lea 3 t effective. Did 
the media used lend weight and impact to the 
content? 

APPLICATION : 

1. Evaluate the method used in this presentation in- 
cluding the following: 

A. The sequence of events - pre-test, post-test, 
media presentation, post presentation activities. 

B. How would you describe this presentation in 
talking with another science supervisor? 

C. What strengths and weaknesses would you point 
out in writing an annotated bibliography which 
included this package? 

0. Would you use this package to present the 

material to other science supervisors? Why or 
why not? What would be your expectations in 
using this package? 

E. Would you use this package to present the material 
to science teacher3? Why or why not? What would 
be your expectations in using this package? 
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F. What additional material and/or activity 
would you add to increase the effectiveness 
of the package? 

G. Indicate a few other methods you think would 
be equal or more eff ec t ive in presenting this 
package? 
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Method Used: 



The same procedure was used with each person although 
some of the questions differed depending on reactions. The 
draft of the presentation questionnaire was used as a dis- 
cussion guide. Rather than tape the comments, which could 
easily have been done due to the equipment arrangement, notes 
were kept and these will be summarized by the material covered 
rather than individual Interviewed. 

A. Bach person was separately briefed on the project: 
(Background, goals, activities) 

B. The Applications Handbook for the Research Section 
was shown and discussed as an example of the approach 
being taken in packaging the modules. The term 
nodule was not used - it appears to be a rather use- 
less 'Jargonese* term. Instead, 'package 1 or 
'instructional package' was used. 

C. A statement es to the objectives of the package was 
given in lieu of an application handbook. The package 
was then presented without comment and the viewer 
given a few min'ites to make notes and think about 

the presentation. 

D. The package was then extensively discussed. Mo limit 
was placed on time an 1 supervisors were encouraged 

to be both frank and honest. 
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PRE/POST TEST FOR LARGE 
GROUP VALIDATIONS 



NATIONAL SCIENCE TEACHERS ASSOCIATION 
1201 Sintocnth $t.. N.W, Washington. D C. 20036 







The following pages represent an attempt on the part 
of the project staff to determine some of your attitudes 
prior to the program. Put your name on the booklet and 
turn it in after you have completed it. 

The responses entered here will provide much needed 
information if we arc to improve the project material. 

Your honest reactions are vital if the project is to be 
successful. We have made every effort to keep the responses 
as brief as possible. 

Complete this assessment before starting any of the 
project materials. At the end of the entire program, you 
will be given a second assessment. If you need more space 
at any time use the back of tho page. 

Mark any questions or comments you would like to have 
us answer in detail and we will respond. 

Thank you for your help. It 
will make things even better 
for future participants. 
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VALIDATION QUESTIONNAIRE 



I. Attitudes 



A. Circle the number that indicates your attitude toward 



Educational Technology. 
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1 2 Ineffective 



B. Circle the number that indicates your attitude toward 
Behavioral Objectives. 
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Structured 
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C. Circle the number thst indicates your attitude toward 
Scientific Literacy. 



1) 


Vague 


2 


1 


0 


1 
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Veil Defined 
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Effective 
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Ineffective 
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Pure Science 
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D. Circle the number that Indicates how you feel about 
your role as Science Supervisor. 
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Difficult 
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Unimaginative 
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Status Quo 
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Change 
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Challenging 


2 


1 


0 


1 


2 


Routine 
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Sad 
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E. Circle the number that indicates how you feel about 
Science . 
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Facts 
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II. A. What are your interests as a supervisor? 



B. What do you feel are your major skills? 



C. What do you feel are your major deficiencies? 



0 

ERIC 
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III. Indicate how you feel about your knowledge and skills as 
a supervisor in the following areas and whether you feel 
that it is a necessary area of interest for the Science 
Supervisor. 





Adequate 


Inadequate 


' Necessary 


j Unnecessary 


1) Public Relations 










2) Personnel 










3) Management 










4) Curriculum Development 










5) Media Equipment 










6) Budgeting 










7) Inventory 










S) Inservice Training 










9) Systems Applications 










10) Individualized Applications 










11) Educational Technology 


* 








12) Evaluation of Teachers 
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Ill , Continued . 





Adequate 


I Inadequate 


Necessary 


Unnecessary 


13) Evaluation of Curriculum 










14) Report Preparation 










15) Laboratory Equipment 










16) Unions 










17) Science Fairs 










18) Student Assessment 










19) National Science Education 
P rograras 










20) Scientific Literacy 
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SINGLE PACKAGE VALIDATION* 

NAME OF PACKAGE 

EDUCATIONAL TECHNOLOGY PROJECT EVALUATION 



1. Would these materials be worthwhile for each of the 
following groups? Rate probable value for each. 

VALUE 



Supervisors 

Teachers 

Administrators 



No 

Use Low 

0 12 3 

0 12 3 

0 12 3 



High 
4 5 

4 5 

4 5 



2. Rate the quality of the presentation. 



QUALITY 



Poor Fair Good Excellent 



Sound 

Photography 



3. Comment and General Impression: (Note here any special 

points as to authenticity, bias, or attitude: also a brief 

statement of how the material affects you.) 



4. Is there any particular portion(s) of the visual or audio 

material you feel should be changed? (List and give reason) 



5. If you had a copy of this material would you use it? 
How? 



One of these was given for each package presented. 
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APPENDIX e 



validation summaries 



the science supervitra" 10 ^ a11 expenses 
nrS? ?"V additional nenfc^? ?“P ervl *°« 



assumed any additional and the su P«viso 
Project assumed Sl^^al. expenses “ 
any - materials and opIraUnf st'afP 3 ~ 11 



O , , 



LARGE GROUP VALIDATION HELD AT HOLIDAY INN, WEST 
PALM BEACH, FLORIDA, DECEMBER 1-5, 1969 



I 



John Arena, Director 
IMS Project . 

NOVA Educational Complex 
Ft. Lauderdale, Florida 33314 



Joe W. Stanton 

Supervisor of Science 

Okaloosa County School Board 

Bay Area Office 

201 Marilyn Avenue 

Ft. Walton Beach, Florida 32546 



H. W. (Dick) Berryman 
Program Specialist I - Science 
Palm Beach County School Board 
3323 Belvedere Road 
P.O. Box 2469 

West Palm Beach, Florida 33402 



John Thurber, Director 
In-Step AAAS Science 
I.T.V. Center 505 S. Congress 
Boynton Beach, Florida 



Carl Combs 

In-Step AAAS Science 

I.T.V. Center 505 S. Congress 

Boynton Beach, Florida 



Anatole B. Kowalchuk 
Science Resource Teacher 
Science Museum and Planetarium 
P.O. Box 6537 

.West Palm Beach, Florida 33405 



John Beakley 

Resource Teacher for Marine Science 
3323 Belvedere Road 
P.O. Box 2469 

West Palm Beach, Florida 33402 



Harvey Casey 
Science Supervisor 

Bay County School Board Staff Office 

1916 Liddon Road 

Panama City, Florida 32402 



Robert Liston 

Secondary Science Coordinator 
Duval County School Board 
1011 Gilmore Street 
Jacksonville, Florida 32204 



Malcolm W. Moser 
Science Coordinator 
Hardee County School Board 
Box 757 

Wauchula , Florida 33073 



Guy T. Cacciatore 
Supervisor of Elementary Science 
Training 

Hillsborough. County School Board 
Instructional Services Center 
707 East Columbus Drive 
. Tampa, Florida 33602 



William D. Thomas 
Science Consultant 
Escambia County School Board 
P.O. Drawer 1470 
Pensacola, Florida 32520 

Robert Kitzmiller 
Consultant in Science 
Manatee County School Board 
P.O. Box 2069 
Bradenton, Florida 



Wiley Kerlin 
Math/Science Coordinator 
Marion County School Board 
P.O. Box 670 
Ocala, Florida 32670 



O 

ERLC 
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Dr. Carl Zweig. 

Supervisor, Science Education 
Sarasota County School Board 
243 i ..atton Street 
Sarasota, Florida 



Mrs. Bettie Palmer 
Coordinatoi ' of Science Education 
Seminole County School Board 
' 202 Commercial Avenue 
Sanford, Florida 32771 



J. A. Moore 

Consultant, Science Education 
Department of Education 
Room 311 Knott Building 
Tallahassee, Florida 32304 



Jack M. Hopper 

.'Consultant, Science Education 
Department of Education 
Room 311 Knott Building 
•Tallahassee, Florida 32304 



Frank Killer 
Curriculum Writer. 
Jupiter Project 
Jupiter High School 
Jupiter, Florida 



Mrs. Jane Hart 
Curriculum Writer 
Jupiter Project 
.Jupiter High School 
Jupiter, Florida 



Mrs. Mary Harbeck 
Science Teaching Center 
University of Maryland 
College Park, Maryland 



George H. Ziener 
Project Administrator 
Educational Technology Project 
National Science Teachers Association 
1201 Sixteenth Street) N.W. 
Washington, ^.C. 20036 



Dr. Albert F. Eiss 
Associate Executive Secretary 
National Science Teachers Association 
1201 Sixteenth Street, N.W. 
Washington, D.C. 20036 



O 
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EVALUATION OF ATTITUDE TEST 



PRE-TEST POST-TEST 
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Educational Technology 
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Random Structure - System 
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Process - Machines 
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Behavioral Objectives 
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Criterion Tests - Norm 
Referenced Tests 
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1 


1 





* Indicates that someone did not answer a question. 
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PRE-TEST 



POST-TEST 



i 



C. 



Scientific Literacy 

1) Vague - Well Defined 

2) Effective - Inefficient 

3) Pure Science - Technology 

4) Facts - Ideas 

5) Suitable - Unsuitable 

6) Applications - Theory 

7) Unwise - Wise 

8) Ej.ploi ting - Conserving 

9) Attitudes - Knowledge 
10) Society - Individual 
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D. Role of Science Supervisor 

1) Difficult - Easy 

2) Well Defined - Vague 

3) Informed - Ignorant 

4) Professional - Political 

5) Rigid - Flexible 

6) Rewarding - Frustrating 

7) Unimaginative - Creative 

8) Status Quo - Change 

9) Challenging - Routine 

10) Sad - Happy 
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PRE-TEST 



POST-TEST 
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3 


1 


1 






6) 


Disciplines - Humanism 




1 






4 




1 


2 


1 


1 


7) 


Uncertain - Established 


1 


1 




3 




1 




2 


1 


1 


8) 


Amoral - Moral 


2 


1 


1 


1 




1 


3 




1 




9) 


Routine - Creative 








4 


1 








1 


4 



O 




II, A) What are your interests as a supervisor? 

The answers changed little between the Pre and Post 
test. Host of the supervisors were interested in 
planning curriculum for the nonacademic student, 
inservice training and scientific literacy. 

B) What do you feel are your major skills? 

The majority stated inservice training and evaluation 

C) What do you feel are your major deficiencies? 
Management and record keeping, difficulties in 
keeping up with the rapid changes in science, and 
pi.blic relations. 

III. Because there was no way to show the degree of adecuacy 

or inadequacy this portion cannot be evaluated too easily 
The majority felt that they were inadequate in Public 
Relations, Management, Budgeting, Systems Applications, 
Individualized Instruction, Educational Technology and 
Scientific Literacy. 
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ANALYSIS OF EVALUATION SHEETS 



FLORIDA WORKSHOP 



SET I - CURRICULUM REVISION 



Most participants rated this package to be of little to 
moderate use to any group, but one person gave it a high 
rating for both supervisors and administrators. 

The tape section of the package was rated good in all 
instances. The photography, however, went from poor to 
excellent . 



Sound 


1 


Poor 


6 Good 


1 Excellent 


Pho tography 


1 


Poor 


2 Fair 


3 Good 1 Excellent 



Most said the presentation was well done although one 
participant felt it "as a good introduction to problems 
but gave no answers. 

There were three comments to this question. 

a) Artwork does not do a good job of interpreting 
the script. 

b) Questions often not direct. 

c) More factual slides - fewer pretty colors. 

Most said they would use a copy of this presentation with 
teachers and administrators but only one would use it 
with science supervisors. 



ANALYSIS OF EVALUATION SHEETS 



FLORIDA WORKSHOP 



SET I - EVALUATION 

1. A wide variation of the value of this package exists. 

Most rated it of medium value to supervisors, one rated 
it of high value to supervisors, and one comment ruled 
out any value to supervisors. Medium value to teachers 
and administration was representative of the participant 
reaction to this package. 

2. The photography was acceptable by all. One participant 

reported the sound to be of excellent quality, however, 
two persons reported a need for accompanying sound. No 
valid assessment of sound can therefore be concluded. 
Sound 1 Fair 1 flood 1 Excellent 

Photography 5 Fair 2 Good 

3. Impressions varied from "nothing new" to "better than 
most." Other comments Indicated that the questions are 
ever present; what is needed are answers or expertise 
in arriving at solutions, particularly in criterion 
assessment. One participant objected strongly to teacher 
evaluation . 
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Evaluation Continued 



4 . No comments . 

5. Possible use of the materials would be with teachers and 
administration, and inservice department heads. Possibly 
some use to novice supervisors. One suggested it be used 
to defend the position of the science supervisor for 
those who knew nothing about it. 
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ANALYSIS OF EVALUATION SHEETS - FLORIDA WORKSHOP 
SET I - MANAGEMENT 

1. Overall opinion suggests it to be weighted in value 
to supervisor:?, but, of little use to teachars and 
administrators . 

2. The sound and photography were of mediocre quality. No 
one found it to be either poor or excellent. 

Sound 1 Fair 12 Good 

Photography 5 Fair 8 Good 

3. Comments varied, the majority being critical. Lack of 
depth and the level o t content of material presented 
plus the speed of presentation were major objections. 

4. The rapid pace of presentation is the outstanding draw- 
back of this portion of the program. 

5. Although apparent reception to the material as stated in 
the remarks, is negative in nature, 7SX of the group 
would find it useful in the future. 



O 




83 



ANALYSIS OF EVALUATION SHEETS 



FLORIDA WORKSHOP 



SET I - PUBLIC RELATIONS 

1. The general opinion was that the material would be of 
value to supervisors, teachers and administrators. 

2. The sound and photography apparently appealed to all 
participants . 

Sound 1 Fair 10 Good 1 Excellent 

Photography 4 Fair 6 Good 2 Excellent 

3. Public Relations was well received. The content was 
absorbed by all and the one dissenting comment was that 
there should have been more written on the subject. 

4. Accepted very well. Some remarks pertinent to minor 
corrections were made. Their tone suggests a need for 
minor changes in wording and slides but none are really 
critical. 

5. Most would use this package to varying ends. 



I 
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ANALYSIS OF EVALUATION SHEETS - FLORIDA WORKSHOP 

l 

SET I - RESEARCH 

1. The group apparently feels this package would be of 
little value to supervisors, teachers* or supervisors. 

2. The sound and photography was of medium quality, neither 
poor or outstanding. 

Sound 5 Fair 6 Good 

Photography 4 Fair 7 Good 

3. Very critical. Opinions state: No depth, no content. 

The surface was scratched but never penetrated. The re- 
narks seem indicate that this is not new, and not 
for practlci g supervisors. 

4. Thu beeper continues to distract. The speed of presentat- 
ion was too fast. 

5. The utilisation for further instruction is highly unlikely. 
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ANALYSIS OF EVALUATION SHEETS 



FLORIDA WORKSHOP 



SET II - TOWARD A DEFINITION 

1. Only six evaluation reports were turned in. Two participants 
thought the material would be of high value to supervisors, 
teachers, and administrators. The other four responded to 
the opposite end of the spectrum indicating low value for 
all three categories. 

2. The sound and photogruphy were rated in the fair to good 
range . 

Sound 2 Fair 4 Good 

Photography 3 Fair 3 Good 

3. The majority of the reports were incomplete. One participant 
liked the portion requiring the learner to make a decision 
and recommended the same technique be incorporated in other 
packages. Another felt the material was irrelevant to 
supervisors but acceptable for an introduction. 

4. The majority of the reports were incomplete. One comment 
indicated a lack of "eye appeal" in this group of visuals. 
Another suggested the entire presentation be changed. 

5. A general consensus indicated that this package would not 
be used by the participants. 
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ANALYSIS OF EVALUATION SHEETS - FLORIDA WORKSHOP 
SET II - THE INDIVIDUAL LEARNER 

Only three evaluation sheets were received. The comments 
on these Indicate a favorable response to the material and 
1 1 8 presentation. 
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ANALYSIS OF EVALUATION SHEETS 



FLORIDA WORKSHOP 



SET II - CLOSING THE LOOP 

1* The value of this package ranges from high to low. Most 
feel It is of little use to supervisors but would have 
from moderate to high value to teachers and administrators. 

2. Sound and photography both averaged a good rating. 

Sound 2 Fair 6 Good 1 Excellent 

Photography 1 Poor 1 Fair 5 Good 2 Excellent 

3. Most participants felt it had value for teachers and 
administrators and PTA, but little use for supervisors. 

A. The two areas which caused the most comment were the slides 
on bees ** bees are'highly organized, so slides should be 
changed - and some did not like the 'bolted down chairs/ 
Another person felt that some of the diagrams were very 
inappropriate . 

5. Most said they would use it for teachers and PTA but only 
two participants felt it had any value for supervisors. 
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LARGE GROUP VALIDATION HELD AT DICKINSON COLLEGE, 
CARLISLE, PENNSYLVANIA, JANUARY 5-9, 1970 



John J. McDermott 
State Department of Public 
Instruction 
Harrisburg Penna. 

Carl Guer r lero 
State Department of Public 
Instruction 
Harrisburg, Penna. 

William H. Bolles 
State Department of Public 
Instruction 
Harrisburg, Penna. 

Dr. Irvin T. Edgar 
Spate Department of lubllc 
Ins t tuc t ion 
Harrisburg, Penna. 

Joseph E. Anthony 
State Department of Public 
Instruction 
Harrisburg, Penna. 

Carl E. Heilman 
State Department of Public 
Instruction 
Harrisburg, Penna. 

Lloyd Woods 
Big Spring Science 
Department 
Newvllle, Penna. 

Mbrtha Adams 
Carlisle Area Science 
Department 
Carlisle, Penna. 

Arlene Guerriero 
Carlisle Area Science 
Department 
Carlisle, Penna. 



Daniel Wilker 
North Schuylkill Science 
Department 
Ashand , Penna. 

* John Clifford 
North Schuylkill Science 
Department 
Ashand, Penna. 

C. Arthur Kadel, Jt. 

Cumberland Valley Science 
Department 

Mechanlcsburg , Penna. 

^Albert Gunter 
Shippensburg State College 
Shippensburg , Penna. 

Gary Bitner 

Shippensburg State College 
Shippensburg, Penna. 

*Jay Davidson 

Shippensburg State College 
Shippensburg, Penna. 

Dr. Benjamin James 
Chairman of Education 
Dickinson College 
Harrisburg, Penna. 

^Charles Beehler 
Rose tree-Medi a Science 
Depar tmen t 
Media, Penna. 

Dr. Gerald Hawkins 
Dr. Gordan Steglnk 
Dr. Scott Smith 
Dickinson College 
Carlisle, Penna. 

Dr. Albert F. Else 
George H. Zlener 

National Science Teachers Assoc. 
Educational Technology Project 
Washington, D.C. 



* Persors attended for the entire five days 
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EVALUATION OF ATTITUDE TEST 



A. Educational Technology 

1) Random Structure - System 
Teaching - Learning 



2 ) 

3) 

4) 

5 ) 

6 ) 

7 ) 



Objective Evaluation - 
Subjective Evaluation 

Validated - Invalidated 

Rigid - Adaptive 

Process - Machines 

Single Learning Source - 
Multiple Learning Source 



8) Realistic - Unrealistic 

9) Effective - Ineffective 
B. Behavioral Objectives 

1) Structured - Unstructured 

2) Learner - Teacher 

3) Criterion Tests - Norm 
Referenced Tests 

4) Objective Evaluation “ 
Subjective Evaluation 

5) Affective - Cognitive 

6) Effective - Ineffective 

7) Group - Individual 

8) Help ~ Hindrance 



PRE-TEST 
2 10 12 



3 2 

2 3 1 

2 1 



4 1 

4 1 

6 

5 1 

3 2 

3 1 

2 11 
3 2 1 



5 1 



2 4 

3 3 



3 3 
3 

1 5 
1 



1 

1 



12 3 



POST-TEST 
2 10 12 



14 1 

6 



6 

6 



6 

6 

6 

6 

5 1 

3 2 1 

1 4 1 

5 1 

2 13 

5 1 



* Indicates that someone did not answer question 
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I 



PRE-TEST POST-TEST 







2 


1 


0 


1 


2 


2 


1 


0 


1 


2 


Scientific Literacy 






















1) 


Vague - Well Defined 


1 


1 


1 




3 






1 


2 


3 


2) 


Effective - Inefficient 


2 


2 


1 




1 


2 


4 








3) 


Pure Science - Technology 


1 




5 










c 






4) 


Facts ~ Ideas 






3 


1 


2 






4 


1 


1 


5) 


Suitable - Unsuitable 


5 


1 








5 


1 








6) 


Applications - Theory 


1 




4 


1 






1 


5 






7) 


Unwise - Wise 


1 






1 


4 








2 


4 


8) 


Exploiting - Conserving 




1 




2 


2 






1 


2 


3 


9) 


Attitudes - Knowledge 


2 


2 


2 






2 


1 


3 






10) 


Society - Individual 




3 


3 






1 


1 


4 






Role of Science Supervisor 






















1) 


Difficult - Easy 


1 




4 


1 




2 


2 


1 


1 




2) 


Well Defined - Vague 


1 


3 


1 


1 






4 


1 


1 




3) 


Informed - Ignorant 


1 


5 








4 


2 








4) 


Professional - Political 


5 


1 








5 


1 








5) 


Rigid - Flexible 




1 




2 


3 








2 


4 


6) 


Rewarding - Frustrating 


3 


3 








4 


1 


1 






7) 


Unimaginative - Creative 








2 


4 








2 


4 


8) 


Status Quo - Change 








3 


3 








2 


4 


9) 


Challenging - Routine 


3 


3 








5 


1 








10) 


Sad - Happy 






* 


2 


4 








2 


4 



ERIC 



91 



I 







PRE-TEST 
2 10 1 


2 


POST-TEST 
2 10 1 


2 


Role 


in Science 


















1) 


Facts - Concepts 




2 


2 


2 




4 


2 




2) 


Outcomes - Discoveries 


1 


2 


2 


1 




3 


3 




3) 


Philosophy - Action 


1 


4 


1 






4 


2 




O 


Society - Individual 


3 


3 






1 


4 


1 




5) 


Personal - Impersonal 


1 4 


1 






1 2 


2 


1 




6) 


Disciplines - Humanism 


1 


2 


3 




2 


2 


1 


1 


7) 


Uncertain - Established 




1 


3 


2 


1 




2 


3 


?) 


Amoral - Moral 




2 


4 




1 


2 


2 


1 


9) 


Routine - Creative 




1 


2 


3 






4 


2 
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II. 



III. 



o 

ERIC 



A) What are ycur intereote as a supervisor? 

The answers changed little between the Pre and Post 
test. Most of the supervisors were interested in 
planning curriculum for the nonacademic student, 
inservico training and scientific literacy. 

B) What do you feel are your major skills? 

The majority stated inservice training and evaluation. 

C) What do you feel are your major deficiencies? 
Management and record keeping, difficulties in 
keeping up with the rapid changes in science, and 
public relations. 

Because theru was no way to show the degree of adequacy 
or inadequacy this portion cannot be evaluated too easily. 
The majority felt that they were inadequate in Public 
Relations, Management, Budgeting, Systems Applications, 
Individualized Instruction, Educational Technology and 
Scientific Literacy. . 
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ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET I - CURRICULUM REVISION 

1. A high value rating was given for this package for Supervisors 
Teachers and Administrators. 

2. The sound portion of this presentation was given only a fair 

rating but the Photography portion averaged a good rating. 

Sound Fair 5 Good 2 Excellent 1 

Photography Fair 2 Good 5 

3. Six out of eight participants felt that the presentation was 
■ good and a very vital part of the program although a couple 

felt it should be__ followed up by methods of curriculum 
revision. ' • 

4. Listed below are some of the comments and suggestions for 

i 

improving the slide/tape materials: 

Each set should have a title slide. 

It was hard to relate some slides to the tape. 

Ideas implied in drawings are not always apparent. 

Too much artwork; live photos are needed to relieve monotony 

5. Most said they would use this package with other supervisors, 

teachers , and administrators in in-service programs. One 

participant would use it in a supervisor workshop but felt it 
would not be applicable to teachers. 



O 
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ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET I - EVALUATION 

1. This package w.s rated of high use for supervisors, but of 
only moderate value for teachers and administrators. 

2. It appears from the ratings that both the sound and photo- 
graphy in this presentation need considerable reworking. 

Sound Poor 4 Fair 2 

Photography Fair 4 Good 2__ 

3. The general comment on this presentation seems to be a big 
question as to the role of the supervisor in evaluation and 
the instruments to be used in performing this task. 

Should objective evaluation criteris be set up for teachers 

Should a supervisor evaluate teacher effectiveness? 

They feel that more information is needed on how to 
evaluate . 

4. The majority felt the presentation moved too fast, the 
quality of sound on the tape was very uneven and that there • 
was too much artwork and not enough live photography. 

5. Most participants said they would use this package for all 
groups although one supervisor thought it to be the weakest 
package of the program and felt it only produced confusion. 



ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET x - MANAGEMENT 

1. Most participants felt this presentation to be of high value to 

supervisors, of moderate value to teachers, and varied from low 
to high for administrators. 

2. Both sound and photography rated from Good to Excellent. 

Sound Good 4 Excellent 3_ 

Photography Poor 1 Fair 1 Good 3 Ex 2 

3. Three people felt that the presentation moved too fast, however, 

all felt that the content was very good. One person said he was 
left with the question: "How do I handle it all?" 

4. There were not too many comments to this question. One felt the 
slides could be of better quality and another did not see any 
reason for two projectors showing nothing but ? on slide. 

5. The average opinion was one of usefulness to all groups. 
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ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET I - PUBLIC RELATIONS 

1. High value ratings were given this package for use by supervis 
and administrators and a moderate value rating for teachers. 

2. The sound portion ranged from good to excellent and the 
Photography was rated from fair to good. 

> 

Sound Good 8 Excellent 2 

Photography Fair 3 Good 7 Excellent 

3. The general impression was a very favorable one. Negative 
comments were that the presentation should be more specific 
and should go more into detail.. 

4. Some of the media comments are as follows: 

Cartoon element not specific for the purpose. 

Presentation needs more variety 

Artwork does not tell the story and should be redone. 

5. Most participants would use the package for all groups. 



O 
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ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET I 



RESEARCH 



1. Overall opinion suggests this package to be weighted in 
value to supervisors and administrators and of moderate 
use to teachers. 

2. The sound portion was rated from good to excellent and the 
photography from fair to good. 

Sound Fair 1 Good 5 Excellent 

Photography Fair 4 Good 4 

3. Two participants thought that specific references to specific 
science education journals would improve this program. 

Another felt that the slides were repeated too often. Two 
others thought it a very good and necessary presentation. 



4. Some of the media comments are as follows: 

The slides move too fast for proper impact. 

Not strong enough on the topic of research. 

There are too many slides in places in the sequence 
without any script to accompany them. 

More live photography is needed. 

5. The general opinion varies. Two participants would not. use 
it at all, four would use it for administrators and super- 
visors, two felt it had teacher value, and three did not 

* 

niswer the question. 



O 
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ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET II - TOWARD A DEFINITION 

1. The value of this package was rated very high for Supervisors 

i 

and moderately high for Teachers and Administrators, 

" * i 

2. The sound portion of this presentation was rated good but the 
majority rated the photogrephy portion only fair. 

Sound Good 6 Excellent 1 

Photography Fair 5 Good 1^ Excellent 1 

3. All participants were in agreement that this presentation 
was well prepared and a necessary one. All felt it should 
have been shown before The Individual Learner and that both 
should be presented on the first day before anything else. 

4. No comments were made here. 

5. The responses to this quer.tion varied. Two didn't reply 
at all, one said he would not use it, and three said they 
would use it for all groups. 
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ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET II - THE INDIVIDUAL LEARNER 
This presentation was rated very high for all three groups. 
Both the sound and photography portions of this presentation 



were rated good. 
Sound Fair 


1 


Good 


8 


Excellent 


Photography Fair 


4 


Good 


7 


Excellent 



The participants were unanimous in their feeling that this 
was an excellent presentation stressing the importance of 
individual differences as a learning factor. 

The following are some of the changes that were suggested: 
Slides should be more uniform in density. 

The flow chart or instructional model was difficult to 
follow and suggested that a flow chart similar to 
those used by computer programmers might be better. 
Slide change was much too fast. 

The letters were too small on the model learning system. 
There was too much artwork and not enough real people. 

Most agreed that they would use this package as part of a 
teacher inservice program. Others felt it would also be 
useful for other supervisors and for administrators. 



ANALYSIS OF EVALUATION SHEETS 



CARLISLE WORKSHOP 



SET II - CLOSING THE LOOP 

1. The value of this package was rated very high for all 
three groups. 

2. Both sound and photography averaged a good rating. 

Sound Fair 1 Good 6 Excellent 1, _ 

Photography Fair 2 Good 6 Excellent 1 

3. All evaluators agreed that this package was very good. 

The material was tied together nicely and it got the message 
across in a direct and to the point manner. Most said that 
it should come earlier in the program. One participant 
would have liked more emphasis on the sequence dealing with 
what educational technology is not. 

4. Most agreed that the visuals were the best in the series. 
They liked the use of actual pictures rather than artwork. 

5. Most participants agreed that they would use this package 
with all groups. 
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